For the contradiction between filtering noise and preserving image detail in image denoising algorithms, a random noise detection algorithm based on fractional differential gradient, was proposed to improve denoising performance of the ideal low-pass filter in this paper. Firstly, the fractional differential gradient templates of different directions were used to convolve with noisy images, and calculate fractional differential gradients in different directions. Then according to a pre-set threshold value, the fractional differential gradient detection figures in different directions could be obtained. If the pixel gradients occurred hopping in all selected directions, and this pixel was determined to be a noise pixel. Finally, only the detected noise pixels were processed by ideal low-pass filter. The denoised image could get a better effect of removing the noise and preserving image detail at the same time. The experimental results show that the proposed algorithm can get a better visual effect, the Peak Signal-to-Noise Ratio (PSNR) of denoised image indicates the denoised image is more closer to the original image: The maximum PSNR by using the ideal low-pass filter is 29.0893dB, meanwhile the maximum PSNR obtained by the proposed algorithm is 34.7027dB. It is an exploration of fractional calculus for image denoising, and provides a new research direction to improve performance of image denoising.